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ABSTRACT 

Current procedures for student evaluation of graduate 
.programs are examined, based on three studies, and a valid measure 
for collecting graduate student evaluations is proposed,* Study one 
surveyed 23 southern universities tc determine tb^ nuttter and type of 
evaluations conducted* Only seven (30 percent) of the institutions 
conduct graduate student exit, surveys or alumni surveys^ Survey 
results are used for different purposes in each institution* 
including program review, self -stud.y/accreditation, ard information 
for the Graduate Assembly- The second study surveyed 69 graduate 
departments at West Virginia University* Some type of formal survey 
and/or interview tfeevaluate graduate programs is-ccrducted by 41 
departments of the^university, 39 (UB percent) indicated that they do* 
not conduct any formal type of graduate evaluation* Survey results 
are used for degree program and curriculum review, for department, 
review, and self-study* A few, departments use the results for faculty 
review. In the third study, the* Graduate Student -Progra* Evaluation . 
test was constructed and tested* Fadtcr analysis reduced the test to 
3 2 items with high internal reliability*. The instrunent was tested 
with 99 graduating master^ and doctoral students* The results 
suggest the*t graduate, students* evaluations of their programs are 
unidimensional in nature, indicating that all areas of the program 
are considered an integral part of the whole experience* The survey 
instrument is appended* (SH) y 
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Abstract ^ — \ 

The purpose o'f this investigation was to examine 
current student evaluation procedures of graduate 
programs and to propose a valid measure for collecting 
graduate "student evaluations. Results from three ■ 
studies are reported . StudjrJJ surveyed 25 Southern . 
universities to determine how man^ and ttie type of 
evaluations conducted. Study II surveyed graduate 
departments at one comprehensive university to deter- 
mine thg types pf evaluations conducted by various, 
departments. Study III designed the .Graduate 'Student 
Program Evaluation instrument. Kesults or a survey of 
99 graduating master's and doctoral students proposed 
a refined GSPE instrument as a valid and reliable 
measure of graduate students 1 evaluation of degree 
programs. 
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STUDENT EVALUATION .OF GRADUATE PROGRAMS IN 

• . . . ' : v 
, SELECTED SOUTHERN UNIVERSITIES 



- - Economic £»s\ies and increased accountability in education have increased * 
the demand 3 f or higher education ^program, review (Harcleroatf, .1980). Economic * 
Jnroblelns and declining enrollments in United States college's and .universities', 
along with student and "societal demands for a more relevant^ education in a * 
rapidly changing job market haye applied* substantial pressures on higher educa- 
tion, institutions 4 to improve their quality df lservice. * Program reviews can 
helfr determine a school's program Quality or weaknesses and provide a.means'to 
shot? support for a program's continuation, enlargement, or termination 
(Dressel, 197fj). Currently, the majority of * the data collecte4 for program x ■ 
reviews are concerned withheadcount enrollments, FTEs, cost of programs and' 
number of degrees* ayarded.- Although the need for such information is un- 
questionable,- further subjective "evaluations by faculty and students 'would . « 
proyide valuable sources of d^ta for program evaluation. " ^ ■ 

. Graduate and professional schools are generally the most expensive 
'university programs (McBath, £979) and are often the programs which are elim- 
inated first in times of' strained budgets* For purposes, of future planning, 
decisions- and improvement * of educational quality, it is essential to'obtaift as 
much- evaluative data on these programs as is feasible. However, currently a 
•vqid exists in. numerous institutions in collecting student evaluations of 0 
graduate programs. The purpose/of this investigation was to examine procedures 
of current student evaluation of graduate programs and to propose a valid 
measure for collecting graduate student evaluations. " . . . * • 



Review of Literature 



The decade of the seventies saw an increase in an awareness that review 
of graduate, programs was necessary. However, few universities have established 
mechanisms to collect a wide variety" of evaluative data. J 

- • ' 1 ' 

..In 1973 the Educational Testing Service (ETS), under the supervision of , 
the Graduate Record Examination Board and the Council of Graduate Schools 
(Clark, 1974), surveyed graduate deans' v opini5ns on the importance of certain, 
program characteristics in fating the quality of doctoral programs, and asked 
how to best measure these characteristics. The ten program characteristics / 
graduate deans rated the highest in determining quality, were as follows:^ 
1) general academic ability of students entering the program; 2) achievements, 
knowledge, and/or skills of students at time of degree completion; 3)> univer- 
sity financial support for the program; 4) library facilities; 5) academic " 
training of faculty; 6) ^purposes of the program; 7) laboratory equipment and 
facilities; 8) course and other educational offerings; '9) admissions policies; 
and- 10) provision for welfare of faculty members. Methods suggested to measure 
these ten characteristics included: judgments by recent graduates, visiting 
experts and faculty on the clarity of program purposes £/M plans as measures of 
the characteristics, ptn*ppses of' the program, and faculty/student satisfaction 
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with* courses arid other offerings as- measures of course and other educational 
offerings. ■ The' surveyed deans specifically noted^hat data on purposes of . 
the program (#6 above) were not collected. » \. , 

In 1976 the Educational Testing Service^ (ETS) conducted another study • 
(Clark, 1976), financed by a National Science Foundation grant and sponsored ; ; . 
by" the Council of Graduate Schools.-' In- the study the premise that] multiple 
indicators were better in judging' program quality*than a single -indicator was 
examined. Questionnaires were sent, to dqetoral stu'dents, recent alumni, and • ^ 
faculty of chemistry* history,* and psychology departments in 25 -universities. 
The results of the study indicated* that .perceptions .and" opinions of a variety ^ 
•of participants in^a* program were relatively inexpensive- and. easy to collect, 
index scores were/compiled and acceptable' validity .and reliability were 
•reported. '• f ■' 0 

' Two clusters of evaluation characteristics emerged from this 1976 study. 
The first measured program size, faculty research, alumni success, quality 
of facilities, and students' academic ability. This cluster was .found more 
often in" institutions' that produced more researchers and scholars, than 
practitioners *or teaVhers.- The 'second cluster measured the perceptions- of 
faculty, students, and recent "graduates on the.climate for learning .quality 
of teaching, land degree requirements. This cl^ter contained , some of the 
same characteristic^ from the earlier 1973 Study, but Was generally overlooked . 
by institutions in judging, the quality of the program -or departm en t. *°™> > 
it was recommended that one set , of, questionnaires could be used f or Jtell of 
three disciplines surveyed in the study and c6lle%tion of data would be 
relatively inexpensive. • " , ' 

In 1977 the Educational Testing Service (ETS) (Clark, 1979) examined the . 
definition of "program review" 'and the purposes of such 'review at 450 univer- 
sity departments . Two major purposed review were discovered: "1) .informing, 
.departmental and institutional decision-makers about a program s strengths 
ana weaknesses as**ne first step in a. process designed to improve J^y, _ 
and 2) to establish a program^ status relative .to. specific standards or in 
relation to the performance of other similar programs (p. 1).' 

/ Ace rding to the ETS survey "50 to 70 percent of ' the department reviews - 
included student "evaluations of courses and\5aching, judgment by Acuity . 
members and -students concerning the departmental. learning -environment (such as., 
intellectual climate, student/faculty relations, whether or not policies are 

/aamListerTd fa3ly and equitably), and student judgment about tneir educational 
-experiences- (such as assistan^tships or , internships;. whether o; no program 
meets student needs, satisfaction with the academic offerings (Clark,' 1979, 
l 2V. Also, threelfourths of the' institutions responding felt that student 
opinions on" teaching, followed by student* and faculty .opinions 'about the-, 
learning environment satisfaction of students with" educational experiences . 
satisfaction of faculty with their employment, graduate twining opinions by., 
alumni, arid alumni career and job accomplishments were very impbrtafit for . 

. decision-making at the department leVel. The majority of institutions 
's^ch information for internal department use, but not for outside accountability 



purposes'. 



r . '. * ' 
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Student satisfaction or opinion has 'been reported to be a valid measure 
in evaluating curriculum, faculty teaching, advisors, and departmental 'per- .* 
formance. .According to Dressel (1976), ins order to evaluate* a curriculum; 

4 opinions should be, sought 'frota faculty* ^employers, and students entering and 
completing a program.' Many problems and dissatisfactions can be discovered, 
from questionnaires or interviews with graduating students. -The results of 
other rede&rch CGostin, 1971) has suggested that students as the consumers' of (% 

,coufse6 are the best subjective judges of the- teaching performance criteria. , 

Review . df studies showed that students' ratings can 'pr^vide-valid and - 
reliable information on the quality of teaching and' courses which pan be used 
to evaluate instruction atid help *f acuity .improve (Qostin, .1971) ' *> ** 

' ' ' ' " /* 

Bare (1980) 'iderjjtified eight academic departmental perfon^nce outcon^s, * 

of which the top OtPcee dealt with .studteqt satisf actional) satisfaction with 
their overall learning experience, 2) satisfaction .with faculty, 'and 3) satis- 
faction with academic>*adtftsing. Students' attitudes-flave been identified^ 
a "unique perspective that should not be overlooked in assessing quality 11 <• 
(Braskamp,, 1979, p. 498), and [ad /useful in making resource allocations, program 
changes; and l^olicy decisions. * 

# * Some researchers, such as Overall (1980), hav^Jsuggested^ that it was 
better to ask alumni to evaluate graduate programs because their opinions are. 
those from people who, are now employed and they can determine how adeqfete 
their curriculum wfes.in preparing them for- tWeir- present positions.- However, 
several disadvantages -to surveying alumni have b^en expressed. Pressel (1976^ 
pointed out that ""since alumni have had a variety of texpefienc^g. after leaving 
college, .they may 'not be able^to recall specific instructors or courses. 
They may remember instructors that were uiore ."entertaining" and forget the 
"better" teachers. Alumni may also become more charitable in assigning ratings, 
not -waptingr to hurt others' feelings. Wood (19'78> also, cited problems vjLth 
obtaining current addresses fcyr alumni and ^associated mailing costs. Despite 
all of these disadvantages of alumni survey; Wise (1980)' has demonstrated *thSfe> 
alumni opinions and ratings were Jiighly correlated with enrolled student 
ratings and ratings were not dependent on job< jrelated variables X Costiri (1971) / 
also" ijotecTthat alumni and, currently enrolled students generally agreed on the 
.use of criteria to rate the instructor qualities. Tlius, alumni' evaluations do 
not provd le significant additional information than do ' student, evaluations and" 
thus, are considered unnecessary at this point. t , s 

The abqve review indicates that student evaluation of graduate programs is 
highly recommended, but infrequently collected in a, systematic manner. There- , 
fore, the purpose of this investigation was to/ examine some k currently. used 
evaluation? and propose a new evaluation measure v This study isolated one 
"natidnal r region, Southern United States universities,- and *Sne institution, 
West Virginia University to further analyze specific evaluation programs. 



— STUDY I 

Method and' Procedures 'f 



r . . _ ^ * , w , 

Twenty-five southern* universities (members of"SUG 25) we^e surveyed by . 
mail to determine U whioJi institutions asked exiting- graduated tudents and/or 

' All 
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alumni tp evaluate their respective graduate programs, and 2) the types of 
surveys or interviews conducted. 1 Of the total 25 institutions surveyed, 23 
,ln8titvtions (92Z) responded. 1 , 

Results •/ ^ y t 

•Vhiiy' seven (30%) of those responding institutions indicated that they 
condjifcted "graduate student exit surveys or alumni surveys. Three conducted 
alumni graduate surveys afid four conducted graduate -Student exit surveys. 
Sixteen institutions indicated they did not conduct surveys or interviews of 
either graduate students or alumni./ , .> .^r 

Of the four institutions that indicated they conducted graduate student 
exit surveys, three sa*d all graduating graduate students each semfe$£er were 
surveyed and one surveyed May graduates only. At three of. the four institu- 
tions, a survey was distributed by the department conducting the survey or the 
Student Placement Office when -the student applied for graduation or receipt 
of diploma. The other . institution distributed the survey by mail after May 
graduation. The return rate for those surveys distributed directly by depart- 
ments was approximately 85-90% at one institution. Those distributed by mail 
reported a 50% return rate. - " 

Various university offices were involved in the development of the survey 
instrument for the seven responding institutions that indicated they conducted 
' student or alumni surveys. Some of those offices listed were: Student Services, 
Student Affairs Planning and Research Office, Institutional Research, Library, 
and the Graduate College. [The. analysis of the graduate surveys, were generally - 
performed by the Student Placement Office, Career Planning, Student Affairs, 
Planning and Research Office, Graduate College, Deans, and Institutional Research. 
The results were used primarily for departmental review, but were also used to 
determine the quality of program review,' placement of graduates, and general 
student attitude toward the university. 

• Three institutions 'indicated that alumni surveys were conducted. Alumni 
were defined as students who had been graduated up to five years prior to 
review. At one institution, advisors of alumni doctoral recipients were surveyed 
concerning employment of their students. Return rates for alumni surveys varied 
from 30-60%, with a 95% return rate from advisors. The instruments used were 
developed primaril/by the various institutional Graduate Schools.' Institutional 
Research and an evaluation committee also had input in the development of two 
of the surveys. Distribution of the survey at two "institutions was through the 
Graduate School and at one through the Office, of Institutional Research. 
Survey results were used for different purposes in each institution such as . 
program review, self study /accreditation, information for the Graduate -Assembly, 
and for general interest. \ 



STUDY II m J 



'1 v . 

Methods and Procedures ^ 

' Eighty-one West Virginia University graduate departments, offering a total 
of 75 master's and 29 doctoral programs, were surveyed by Campus mail to 
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determine 1) whidi departments routinely asked exiting graduate students 
and/or alumni to evaluate their graduate programs, and 2) the .type of surveys 
or intervievs conducted. Of the total, 81 departments surveyed, 69 departments 
(85%>)^esporftted. (See Table 1 for department and college indications of 
return.) v \ ' 

j Results % 

*Some type of formal survey ,and/or interview to evaluate graduate programs 
was conducted by 41. departments (51%) of the responding graduate departments. 
Surveys of exiting, graduate students were conducted by eight departments and 
alumni surveys were conducted by 14 departments. Six departments indicated that 
( they conducted formal graduate student exit interviews. Of the tota^ 81 
departments surveyed, 39 (48%) indicated that they did not conduct any formal 
type pf graduate evaluatioh. Thirteen departments said they conducted "other" 
',£> types of evaluations such as surveys of employers and informal exit interviews. 
Eight departments indicated that they conducted more than' one type of evalua- * 
tton.- For example, the department of Rehabilitation Counseling said fchey 
surveyed exiting graduate students, graduate alumni and employers.. 

» * * 

Graduate Student Exit Survey : Of the eight departments that indicated *• 
they conducted exit surveys, four said that all exiting 'graduate students were 
surveyed either by departmental maj.1 or by advisor /faculty . Of those students 
surveyed in this manner 80-100% completed the evaluations ► These surveys were 
developed by departmental staff /faculty and/or a graduate committee, 

' ' . . / * • ' - 

Analyses of results from departmental surveys were distributed primarily 
to the' departmental chairperson and faculty. Two education departments, 
reported the results to accreditation agencies and one reported them to federal 
and state education agencies. One department also noted the results were used 
in grant funding proposals. Results were primarily jused^ for curriculum 
review (6 departments) . Four departments used the results for program, depart- 
ment review, and self study. Only one department considered the results in 
faculty evaluation. 

Alun i Graduate Surveys : Fourteen departments indicated that they con- 
ducted alumni surveys. Ten departments said they surveyed all alutimi of 
selected classes' for whom tfrey had addresses. One department surveyed all 
gradfqtes of their progr^ within the last 25 years and another surveyed those 
of the l^st 10 years. Two departments chose random samples. Five departments 
•had conducted on^-time, surveys two to eight years ago. Annual surveys wern 
conducted by three departments. The* rest of the departments' indicated they . 
surveyed alumni every ^Chree -to five years. Alumni returns ranged from 20-100% 
depending on the size 'of the program's graduating class surveyed, the smaller 
the class, the higher percentage the return. Of the ten departments that 
reported return rates, six had 50% or less return rate. 

Departments indicated that the survey results were primarily used for 
' . degree program and curriculum review. Eight departments used the results in 
sel£-study, and five used them for departmental review. Only two departments 
considered the results in faculty review. Two departments shared results with 
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their dean and one with the central aflminist ration. Three departments sent 
•results to state and local 'education departments. Only one department sent 
result?: to an accreditation agency. 

• f » . 

Graduate Student »Exit Interviews : Formal exit interviews of graduate 

'students were conducted by six departments.' Tte exit interview in two depart- 
ments was. considered mandatory. The program clttirperson, associate chair- 
person, and/or members of the graduate committee conducted the interviews. • 
Results of the interviews were used primarily for degree program review. 

Other Methods of Evaluation: Thirteen departments indicated' they used 
other methods of evaluation instead of, or in addition *to, graduate exit or 
alumni surveys. Employers or supervisors of past graduates were surveyed by. 
five departments. Other types of surveys mentioned were surveys of current 
students, V™cticum ctudents, cooperative teachers, undergraduate students, 
and executives in a particular field. Some departments mentioned personal 
contacts, informal exit interviews, oral problem report reviews, and students 
regular input to the program as methods of evaluation. 

> Eight departments mentioned that their programs were so small that they 
had regular Contact and input from their graduate students. Personal contact, 
even after graduation, ^ was mentioned by four departments. Unstructured 
informal exit interviews during final exams or the student's oral defense were 
mentioned by six departments. Exit interviews of drop-out students were 
conducted in two departments. One department indicated graduate student input 
or evaluation of programs was obtained from a student representative on the 
program review committee. Other forms of input fromjalumni were from contacts 
at professional meetings or though newsletters. Four departments mentioned 
they had plans to conduct an exit or alumni survey in the future. 



STUDY III 

The ultimate purpose of this investigation was to .develop a valid and 
reliable instrument to evaluate graduate students' perceptions of degree 
programs. Several instruments have been proposed to measure student evaluations 
of degre- programs (Levine & Weitz, 1968; Astin, 1970; Stern, 1970; Berd'e, 
Pilapil, & Im, 1970; Anderson fc'Berdie, 1972; Henard, 1975; Bowen & Kilmann, 
1975; FeUd & Schoenfeldt,* 1975; National Center for Higher Education Management 
Systems,* 1977; "Following up Graduates. . ., 1977, Feild & Giles, 1980). A 
review of the instruments indicated that some measures were specific to a type 
of graduate student, e.g., MBA students, graduate assistants, etc. (Andercon & 
Berdie, 1972; Feild & Giles, 1980), and others measured only a part of the 
total graduate school experience, e. g. , educational climate, jotj satisfaction, m 
student employment, etc. (Berdie, et al., 1970; Stern, 1970; Levine & Weitz, 
1968; Astin, 1970; Bow$n & Kilman, 1975; Feild & Schoenfeldt, 1975; National 
Center for Higher Education Management Systems, 1977. Attfiough these instruments 
offer significant insight into the measurement of student evaluations, no one 
instrument was considered a valid measure of a comprehensive graduate program 
evaluation. Therefore, in this investigation a new measure was designed and its 
reliability and validity tested. 



I 
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InstrmAent Development . 

Th ■ resrlts of Study I and Study II produced seyeral measures used by 
-universities to measure graduate student evaluations of" degree programs. 
'These measures, along with those "listed abov«, were reviewed and a list of 
55 topics to be used for the evaluation of graduate programs was developed. 
This iist of topics was then subdivided into the categories of curriculum, 
academic advising, administrative procedures, faculty an^ teaching, univer- 
sity facilities, and learning environment. A 48-iteqj, self-report,' Likert- 
type Graduate Student Program Evaluation (GSPE) instrument was developed to 
obtain graduate students' perceptions of. these areas. , For purfposes^of this L 
instrument, some categories were combined resulting in nine items measuring 
(Uirriculuri, seven items measuring graduate advising, eleven itfems measuring 
facilities and administrative policies, fifteen items measuring graduate 
faculty* and five items measuring learning environment XS§e Table 3). 

Methods and Procedures' k 

v 

The'Graduate Student Program Evaluation (GSPE) was distributed to 350 
Summer, 1981 graduating master's and doctoral studeijts at West Virginia 
University. The surveys were mailed to students along with a letter from 
j the Dean of the Graduate School and a stamped return envelope. All responses ; 
were anonymous. 

* * 

A ctitoff date was set for October 2, 1981 for the preliminary analysis. 
101 (29%) questionnaires were returned before that date. Two questionnaires 
were^ot f^ly completedTlnd thbs, were eliminated N from' further analysis, 
resulting in au'n of 99. The sample consisted of 4^ females and 50 males, 
19 doctoral graduates and 80 masters graduates,' the average length of time 
to complete the degree was 32 months, and the average age was 29 years. 
Thirty-seven degree awarding departments wer£~x5eifresentQd. 

S tatistical Analysis / " 

The 4$>~item GSPE was divided into the five determined categories 
(Curriculum, Graduate Advising, Facilities and Administrative Policies, 
Graduate "acuity, and Learning Environment). Item-total correlations were 
computed, by category, to determine if any items should be eliminated before 
further analysis. Those items with < .50 correlations were eliminated'. 
The items were curriculum, #8 and #9, facilities and administrative policies 
If, #3, //8, //9, 110, and 111, and faculty 110 (See Table 3). * 

The remaining 39 items were then analyzed using a principal axis ( 
factor analysis with oblique rotation (Statistical Analysis System). An 
eigenvalue of 1.0 and the scree test were used as criteria for the number 
of factors to be extracted. Factors were required to have 2 items loading 
at .60 or above. Further,, regaining items maintained on factors were required 
to have a primary factor loading of at least .AO. 

y 

Internal reliabilities on each factor were computed using Nunnally s 
(1967) method. * - 
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The principal axis factor Analysis with oblique rotation for 5 factors 
of the 3$ items. indicated that-Factor 1 had an eigenvalue of 12.6618 
accounting for 33.5% of the variance, the next Factor liad an eigenvalue of 
2.9983 and 7.9% variance, Factor 3 had an eigenvalue of "2. 3696 and 6.2% 
variance, Factor 4 had an eigenvalue of 2,0400 with 4.7% variance, and 
Factor 5 'had an "eigenvalue of 2.0400 with 4% variance. Only Factors 1 and 
2 met the criterion of 2 or mote items of .60 loading or above, thus, the 
data was submitted to a second factor analysis with oblique rotation calling 
for two factors. This analysis' yielded only 1 factor which met the 2 or more 
items of .60 loading criterion. A final factor analysis was computed demon- 
strating thjit the GSPE instrument was a unidimensifcnal measure (See Table 4. 
for unrot^ed factor pattern) accounting for 33^ variance. This result is 
consistent with the scree test criterion. Based on the .40 loading criterion 
to retain an item, the following items were eliminated (Sfee Table 3 for items): 
Facilities and Administrative Policies #4, and #7; and Learning Environ- 
ment #3, #4, and #5. The resulting GSPE contained 32 items with a .95 
internal reliability (Nunnally, 1967). 

\ DISCUSSION * 

I The purpose of this investigation was- to examine current procedures in 
graduate student evaluations and propose a valid and reliable instrument to 
measure such evaluations. From a v review *>f existing published and unpublished 
measures, the Graduate Student Program Evaluation test was constructed. Factor 
analysis helped to reduce the test to 32 items with high internal reliability. 

Several cautions stjrfuld be noted about this investigation. First, due 
to a low initial return, the above analyses used only 99 subjects. Factor 
analysis for a 4f-item test actually calls for a conservative sample size of 
200. Second? only 33.5% variance was accounted for by the GSPE. Before final 
adoption of this measure, we plan to add additional items tb the test. These 
items will come from open-ended questions returned by the subjects concerning 

(1) what students best liked about their graduate studies at the university, 

(2) what they least liked, "(3) what things should be kept in their graduate 
program, and (4) what things should be changed. With the inclusion of these 
items, the instrument would then be subjected to the analysis described above 

"before its final form is adopted. x ' 

The investigation suggests that graduate students' evaluation of their 
programs are unidimensional in nature, indicating that all areas of the program 
are considered an integral part of whole experience. As such, it appears that' 
if an institution is sincerely interested in obtaining students' perceptions • 
of degree programs, then all such elements should be considered. 
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TABLE . 1 



DEPARTMENTS SURVEYED AT WEST VIRGINIA UNIVERSITY AND RATE OF-RETURN 

» 



Col 1 ege 



Number of 
Graduates 
Departments 



Number of 
Responses 



Return 
Rate 



College of Agriculture & Forestry 
College of Arts & Sciences 
College of Business & Economics 
Creative Arts Center 
School of Dentistry 
School of Engineering 
College of Human Resources & Education 
School of Journalism 
School of Medicine 

College of Mineral & Energy Resources 
School of Nursing 
School of Pharmacy 
School- of Physical Education 
School of Social Work 

TOTAL 



17 

16 
4 
4 
2 
8 

12 
1 
7 
4 
1 
1 
3 

_1 

81 



16 
12 
3 
4 
2 
7 
9 
1 
5 
4 
1 
1 
3 
_1 

#9 



94% 
75% 
75* 
100% 
100% 
88% 
75% 
100% 
71% 
100% 
100% 
100% 
100% 
100% 

85% 



TABLE 2 

TYPE OF EVALUATION CONDUCTED BY COLLEGE* 



College 



Graduate 
Exit 
Survey 



Graduate 

Exit 
Interview 



Al umni 
Survey 



Other 
Eval. 



No 
Eval 



ERIC 



College of agriculture & 

Forestry j 
College of Arts!& Sciences 
College of Business & 

Economics 
Creative Arts Center 
School of Dentistry 
School of Engineering 
Col J ege of Human Resources 
' & Education ^ 
School of Jfurnalism 
School of^Medicine 
College of Mineral and Energy 
* Resources 
School of Nursing 
School of Pharmacy 
School of Physical Education 
School of Social Work 

TOTAL 



8 



1 

2 



2 
3 



1 



13 



A 

14 



13 



13 
4 

1 
2 
1 
4 

2 
1 
3 



1 

3 

39 



♦Some departments indicated that they used more than one method of evaluation., 
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TABLE 3 

GRADUATE STUDENT PROGRAM EVALUATION 



In struction Format 

Please respond to all statements below 1n reference to the parti cular 
department/program/school 1n which you completed your degree. Place in the 
space provided the number which best describes your opinion using the follow- 
ing scale: 

* 1 = Strongly Disagree 
2 = Disagree 
-^3 = No Oplnit n 
4 = Agree c t 

, ' 5 = Strongly Agree 



GRADUATE CURRICULUM : , 

1. The majority of courses completed toward my degree were valuable 
1n pursuing my chosen career .> 

2. The majprlty of my WVU courses taken provided indepth study^and 
understanding of my^ area of study. 

3.. Coursework completed at WVU gave me only a narrow perspective of 

my field. 

4. The»courses I wanted -to take at WVU were readily available. 

5. Courses at WVU did not adequately prepare me for future employment. 

6. The curriculum of my major deparjjhent met my need's as a student. 

7 - Tne curriculum at WVU did not^eet my expectations of graduate 
' study. 

t> t8. There was freedom 1n my department to choose the courses to complete 
» 9. Requirements for graduation were clearly specified for graduate 
students 1ri my department. M ' C'- 

& ■ ' 

GRADUATE ADVISING : 

4. My adviser had a thorough" knowledge of graduate school policies 

and procedures. 1 

2. My adviser's knowledge offlfjy area of study was minimal . 

"~~ 3. My adviser was not readily available for assistance. 



4. My adviser was helpful to me as a gradual student . 

5. My advfser was supportive of me as an 1nd$Tdual. 

6. My adviser was Instrumental 1n helping me obtain a job. 

7. My adviser d1scouraged*a professional attitude and perspective 
toward my field of study. 
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TABLE 3 (continued) 



WVU FACILITIES AND ADMINISTRATIVE POLICIES : 

i 

*1. WVU*provides an efficient process of registration. 

2. There was an unfair and inequitable administration of graduate 

policies at WVU. 

*3.. My department/school kept up-to-date graduate student records. 

*4. Requirements for graduation are clearly presented by the WVU 

Graduate College. 

5.' WVU supports adequate research facilities for graduate students. 

*6« WVU teaching facilitiesr-^re adequate. 

*7. Office facilities for WVU graduate students are substandard. 

*8. Morgantowrf\fc WVU^eusing for graduate students is adequate. 



*9. WVU financi£h*£ssi stance for graduate students is inadequate. 
40. WVU library facilities in my field are adequate. 
[11. WVU placement service was helpful to me in obtaining employment. 



GRADUATE FACULTY : * 

1. The faculty in my department project a professional attitude. 

2. I was dissatisfied with the teaching by WVU faculty. 

3. The faculty in my department demonstrate a limited knowledge of 

the field. / 

4. The WVU faculty demonstrated an up-to-date knowledge of subject 

matter presented in courses that I completed. / s 

5. The faculty in my department stimulate an intellectual climate. 

. 6. WVU faculty go /£>t motivate graduate students. 

7.._/The faculty thirty department stimulate productive student/ 

faculty relations. 

8. The faculty'in my department provide frank feedback of my 

.graduate work. ^ 

9. The faculty in my departmfjjrt do "not help graduate students. 

• *1 0. Th^jfaculty in my deparfttieht are productive in conducting research. 
1 1. I received critical evaluation of my graduate work at WVU. 
12 WVU faculty are not receptive -to differing opinions and information. 

13. Assignments given during my graduate work were relevant to advancing 

my knowledge of the field. 

- 14. The faculty in my department were fair in their grading of graduate 

work. 

15. The faculty in my department provided adequate direction to complete 

my degree. 

LEARNING ENVIRONMENT : 

1. The overall learning climate at WVU is stimulating. 

2. The atmosphere in my department is more cooperative than competitive. 

My work >at WVU helped me become a better communicator,. 
The social life in Morgantown and at WVU hampers successful graduate 
study. % - n 

My personal relationships durin^cjraduate study provided a comitjrt- 
able learning environment. 




m$Lqra< 

_2 



ERIC 



♦Eliminated from further use^after statistical analyses. 
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TABLE 4 



A 



UNROTATED FACTOR PATTERN OF 
GRADUATE STUDENT PROGRAM EVALUATION 



Item** . Loading 



CI .58619* 

C2 .60979* 
C3 * -.63370* 

C4 ' .42450* 

C5 -.48746* 

C6 .64191* v > 

C7 -.69064* 

Al .54208*" 

A2 -.52094* 

A3 -.45484* 

A4 .71020* 

' A5 . * .59919* 

A6 .46925* 

A7 -.46459* 

FP2 S .41013* 

FP4 ' S .39613 

FP5 .42187* 

FP6 .32988 

* FP7 -.13554 

Fl .65629* 

" F2 -.64235* . 

F3 • V -.69507* 

' - F4 V .61446* , 

F5 ^ .79712* 

F6 ' -.73704* 

F7 .76594* 

P8 .72815* 

F9 -.75914* 

Fll .58382* 

F12 ' -.48831* 

F13 .70007* 

F14 .65434* 

F15 .73034* 

LEI .60668* 

LE2 • .61680* 

LE3 .35626 

LE4 - .00020 

LE5 .33297 



♦♦Items are referenced In Table 3 

C ■ Curriculum 
A ■ Advising 

FP « Facilities & Administrative Policies 
F ■ Faculty 

LE • Learning Environment 
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